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Abstract. Deriving the time evolution of a distribution of probability 
(or a probability density matrix) is a problem encountered frequently in 
a variety of situations: for physical time, it could be a kinetic reaction 
study, while identifying time with the number of computational steps 
gives a typical picture of algorithms routinely used in quantum impurity 
solvers, density functional theory, etc. Using a truncation scheme for the 
expansion of the exact quantity is necessary due to constraints of the 
numerical implementation. However, this leads in turn to serious compli- 
cations such as the Fermion Sign Problem (essentially, density or weights 
will become negative). By integrating angular degrees of freedom and 
reducing the dynamics to the radial component, the time evolution is 
reformulated as a nonlinear integral transform of the distribution func- 
tion. A canonical decomposition into orthogonal polynomials leads back 
to the original sign problem, but using a characteristic-function repre- 
sentation allows to extract the asymptotic behavior, and gives an exact 
large-time limit, for many initial conditions, with guaranteed positivity. 



1. Introduction 

The notion of coarse graining in statistical physical models (or field the- 
ory) , introduced by Migdal and Kadanoff pQ , [2] is essential to many funda- 
mental concepts and results, like the continuum limit of lattice models, or 
the universality of scaling behavior near a phase transition, to name two of 
the most celebrated consequences. 

From the perspective of mathematical statistics, the analysis of such 
coarse graining processes is straightforward due to the fact that the el- 
ementary operation of the process is averaging: at step n, we create a 
new random variable X^ from two variables defined at step n — 1 by 
X( n ) = [x[ n l ' + ]/2. Then by repeated application of this oper- 

ation, the result after sufficiently many steps is simply given by the central 
limit theorem (CLT). 

In this work, we consider another class of coarse-graining processes, where 
at each step we take the absolute difference between variables, rather than 
their average. This is justified by a number of relevant physical problems, 
but also by classical issues from decision theory or economics. As in the 
case of standard coarse graining, there is a limiting distribution (in fact, a 
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whole class) which will be reached after arbitrarily many steps. Unlike in 
the standard case, the particular limit is chosen from this class based on the 
asymptotic properties of the initial distribution (more precisely, the radius 
of convergence of its moment-generating function) . This is an example of the 
extreme selection criterion which characterizes other important stochastic 
processes, such as the Fisher-Kolmogorov evolution. 

The structure of this paper is the following: in the first section we present 
the difference coarse-graining procedure, as well as some of its realizations, 
and derive its universal long-time asymptotic behavior. In the second sec- 
tion, we consider some particular types of distributions which are useful 
examples for the general results. The last section is a discussion on possible 
applications of this new universal limiting behavior. 

2. Difference coarse-graining processes and asymptotic limits 

2.1. Excess redistribution and partial annihilation models. In the 

excess process, one starts with random variables — oo < y« < oo for i = 
1,...,N. These variable are initially distributed according to some pre- 
scribed distribution Po(y). Then, two variables y\ and y 2 are picked at 
random. If both are positive or both are negative, nothing is done. If one 
is positive and one is negative, then this variables are updated as follows 

(2.1) (y u y 2 ) -> (yi + y 2 ,0). 

Thus, this process conserves the total sum ^2 i yi- A related process was 
considered in [3] 

Let P(x,t) be the time-dependent probability density of the process. It 
evolves according to the rate equation 

o 

(2.2) ^l = - c{t )P( x ) + J dyP{y)P{x-y). 

— oo 

This equation holds for x > and a similar equation holds for x < 0. The 
integral has a convolution form. Here c(t) is the total density of non-zero 
variables. 

One motivation for this process comes from economics. A positive y 
represents wealth and a negative y represents debt. The economy evolves 
under conservative exchange of excess wealth. Another motivation is the 
electric power-grid where power producing plants may exchange excess or 
deficit capacity in response to power demands. 

Let us assume that the initial distributions are symmetric Po(y) = Po(—y). 
Clearly, this property persists with time. Therefore, the above process 
may be equivalently formulated by considering the evolution of the vari- 
able x = \y\. Then, the excess process becomes 

(2.3) {x\,x 2 ) ->■ \xi - x 2 \. 
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Let c(t) be the remaining fraction of non-zero variables at time t. This 
quantity satisfies 

Solving this equation subject to the initial condition c(0) = 1, we find 

1 



(2.5) c(t) 



l + t 



Next, we consider P(x,t), the probability density. This quantity evolves 
according to the integro-differential equation 

oo 

(2.6) ^l = -2c{t)P{x) + 2 J dyP(y)P(x + y). 

o 

The negative term accounts for loss of two interacting variables and the 
gain term accounts for gain of one variable. Of course, the total density 
is c(t) = f dxP(x). Integrating this equation, we recover (|2.4p . Despite 
the simple nature of this equation, it is challenging. For example, the first 
moment M\{t) = J Q xP(x)dx does not obey a closed equation. 
Consider the normalized distribution 

(2.7) p(x,t) = c~ 1 P(x,t), 

so that J dxp(x,t) = 1. It satisfies the evolution equation 

oo 

(2.8) — = -cp{x) + 2c / dyp(y)p(x + y). 

o 

Now, we introduce the new time variable 

(2.9) r = ln(l + i). 
The master equation becomes 

oo 

(2.10) = -p{x) + 2 J dyp{y)p{x + y). 

o 

This master equation represents the dual process (xi, X2) — > (\x± — a^l, |^i — 
X2I). This process occurs with rate 1/2. In this formulation, the number of 
particles is conserved J dxp{x) = 1. 

In the following section we explore the general properties of the long-time 
behavior of the probability density function. We prove that there exists 
a whole class of exact solutions, and quantify the convergence rate of an 
arbitrary distribution towards the appropriate infinite-time limit. 
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3. Convergence properties of the difference coarse graining 

3.1. Steady-state solutions. At the steady state, the probability density 
satisfies 



(3.1) p(x) = 2 dy p(y) p(x + y) 



o 



Performing the Taylor expansion of p{x + y) with respect to variable y and 
integrating, we obtain 



(3.2) p{x) = 2 -id n xP (x) = 2m(d x )p( 



n! 

n=0 



where m(t) = YlnLo M n\ * s ^ ne momen t generating function of p(x), and 
M n is its non-centered moment of order n. Equation (|3.2|) can also be written 
in the eigenvalue form 

(3.3) mT l (d x )p(x) = 2p(x), 

with m _1 understood as the corresponding inverse pseudo-differential op- 
erator. In this form, it is very simple to notice that (|3. 2[) has a continuos 
family of solutions, exponential distributions p{x) = Xe~ Xx , A > 0, for which 
the inverse moment generating function is m^" 1 (t) = 1 — £A _1 : 

(3.4) [1 - A-^e"** = 2e- Xx . 



Identity ()3.4p shows that there exists a class of solutions indexed by the 
continuous parameter A > 



(3.5) p(x) = A e 



-A x 



The fact that this coarse-graining process evolves towards a universal limit 
(in functional sense) bears some resemblance to the Central Limit Theorem. 
In that case, the limit (properly rescaled) is determined by the second mo- 
ment of the initial distribution. We will show that in the case of difference 
processes, it is not a single centered moment which determines the limit, but 
rather the convergence properties of the whole momen-generating function. 
In the next section, we investigate how initial conditions determine the par- 
ticular steady-state of type (13. 5p realized by a particular process, as well as 
the convergence properties of the evolution towards the solution. 



3.2. Asymptotic analysis. In order to establish the steady-state reached 
by a difference coarse-graining process, as well as to characterize its conver- 
gence, we reformulate the evolution (|2.10p through characteristic functions, 
since convergence in distribution (weak convergence) is equivalent to point- 
wise convergence of characteristic functions, 4>(z,t) = E[e lzx ]. 
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Define the charateristic function of distribution P(x, r) as 

OO 

(3.6) 4>{z,t) = J e izx P(x,r)dx, 



and obtain for the evolution equation 

OO 

(3.7) P(x, t) + P(x, r) = 2 J P(y, r)P(x + y, r)dy 

o 

the form 

OO OO OO 

4>(z,t) + <P(z,t) = 2 J J J P(y,T)P(w,T)e izx 5(w - x - y)dydwdx. 



Use the standard representation for Dirac's distribution and obtain 

OO OO OO OO 

(f>(z,T) + <j>{z,T) = 2 J J J J P(y,T)P( y w,T)e i ^ zx+ ^ w - y - x ^dydwdx^-. 

oo 

Perform the integration over x using the limit 

OO OO 

(3.8) ! e ix{z ~ k) dx = lim f e ix{z - k+it) dx = lim ) -. 

J €-y0+ J e^o+ i{z — k + ie) 



Now integrate over y, w and get 

OO 

(3.9) r) + fc, t) = lim -L / ^T^W , r)dk, 

e — ^0"*" Z7TZ J Z K ~t~ l€ 

— oo 

which can be written as the Cauchy integral over the boundary of the lower 
half-plane A, in clockwise direction: 

(3.10) Hz,t) + <P(z,t)= timJ m ~ k > T h (k,T)^. 

e^o+ J z — k + ie 2m 
A 

Equation (|2.10j) becomes: 

(3.11) 0( S; r) = -0( a , t) + ^-J 0( ~*' T) 4(z, r)dz, 

2m J s — z + ie 
A 

where A is the boundary of the lower half-plane with standard counter- 
clockwise orientation, and e — > + . In order to derive (|3.1ip . a standard in- 
tegral representation was used to express the singular distribution 8(x)9(x), 
where 6, 9 are the Dirac and Heaviside distributions, respectively. 

Equation (13. IIP requires a discussion which highlights the physical as- 
pects of the steady-state selection. At the heart of this discussion lies the 
definition of characteristic function for arbitrary complex values of the pa- 
rameter z. One way to define (j>(z),z € C would be directly through the 
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integral J e lzx P(x)dx. However, we immediately encounter convergence is- 
sues with this formulation: assume that the moment- generating function 
m(t) = f e xt P(x)dx has a radius of convergence t < A. Then obviously the 
characteristic function will also diverge for Sj(-z) < —A. In this way, it is not 
possible to define a holomorphic function 4>(z) in the whole complex plane, 
unless A = oo. A different generalization of the definition of <f>(z) is therefore 
required. 

The obvious alternative is to start from the standard characteristic func- 
tion 4>(z) defined on the real axis ^(z) = 0, and to analytically continue 
it into the whole complex plane. As we shall see, the convergence radius 
given by the moment-generating function will still play an important role, 
by determining the location and type of singularities of this holomorphic 
function, but otherwise it will be possible to use standard complex analysis 
techniques to study equation ()3.11j) . For example, for a pure exponential 
distribution of parameter A, the characteristic function has the form 

(3.12) ^(z) A 



A — iz 



Thus, this function has a simple pole at z = —iX, and the convergence radius 
is precisely A. However, since <j)(z) is now defined everywhere on C \ {— iX} 
as an analytic function, it is possible to perform the integration in (13. 11 ^ . 
The fact that any pure exponential is a steady-state solution, reduces in this 
language to a simple application of Cauchy's theorem. 

In this paper, we will consider other distributions related to the exponen- 
tial, like a product between a polynomial and an exponential, 

N , , s n 

(3.13) p(x, r = 0) = AV A (0)^e- Al , 

n=0 

or a superposition of exponentials, 

oo 

(3.14) p(x,r) = J dX'f(X',r)X'e- x ' x , 



as well as generic sub-asymptotic corrections to the exponential of Gamma- 
type: 

(3.15) p(x) ~r(Q + l,A" 1 ), a >0. 

For a distribution of type (|3.13p , the analytic continuation of the character- 
istic function is 

N / \ \ n+1 

(3.16) <j>( Z ,T)=Y,Pn(r) TZ- , 

n=0 ^ %Z ' 
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while for the type (I3.14p . it is 



oo 



(3.17) <Kz,t)= I f(X',r)-^-dX'. 

J X -iz 

A 

In the first case, the singularities are multiple poles at z = —iX, while 
in the second, we have a branch cut extending from — iX to —too, with 
jump function X' f(X') Finally, for the general case ()3.15p . the characteristic 
function combines both singularities, having a distribution of simple and 
multiple poles from — iX to oo. It is given by 



oo 



A 

where f(X') represents the jump of the function (z — iX) 6 " 1 accross the 
branch cut, and a = n — e, < e < 1, n 6 N, n > 0. 

4. Direct analysis for some particular types of distributions 

In this section, we illustrate the convergence of coarse-graining for dif- 
ference processes towards a pure exponential distribution on a couple of 
examples which cover all the types of singularities identified previously. 

4.1. Polynomial times an exponential. The integral in (|2.10p has an 

interesting invariance property. Starting from an exponential times a poly- 
nomial (|3. 131) 

(4.1) p(x,r = 0) =xJ2Pn(0)^ : e- Xx , 



n=0 



with Yln=oP n (®) = 1 to ensure proper normalization, the probability distri- 
bution retains the same form 

(4.2) p{XjT) = X ^Pn(r) { -^e~ Xx . 

n=0 

The coefficients p n {j) satisfy a nonlinear evolution equation. We show this 
for the lowest values of N. 

1) N = 1 When the polynomial is linear, the system evolves according 
to 

(a Q^ d P l 1 2 

(43) ^ = -~2 P ^ 

Therefore, the constant p\ asymptotically decay according to 
(4.4) Pl ~ IT' 1 . 

Thus, the system flows toward the fixed point (13. 5j) . 
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2) N = 2 When the polynomial is quadratic, the two independent co- 
efficients obey 

dpi 1 n 1 3 1 o 

~dr = ~2^ + 2 P2 ~ A P1P2 ~ 8 P2 

dp2 1 3 2 

~dr = -2 P1P2 ~4 P2 - 
The last two terms in the first equation and the last term in the 
second equation are irrelevant asymptotically and consequently 

(4.5) p\ ~ 4t~ 1 p 2 ~ 8r~ 2 . 

3) N > 3 Generally, the coefficient satisfy 

(a r\ dp n 1 1 

(4-6) l^ = -2 PlPn+ 2 Pn+1 + --- 

for 1 < n < N with the boundary condition P/v+i = 0. Here, we 
kept only the two asymptotically relevant terms. The coefficients 
decay as follows, p n ~ t~™, and it is even possible to obtain the 
prefactor 

(4.7) P ^^W^ TT - n - 

Therefore, the asymptotic behavior is independent of the initial condi- 
tions. Thus, starting from an arbitrary exponential times a polynomial of 
the form ()3.13j) . the system approaches the purely exponential fixed point 

(4.8) p(x) -> Xe~ Xx 
as t — > oo. 

The average of the variable x, K(x) = J °° dxxp(x), converges to a con- 
stant value according to 

(4.9) E(x) - A" 1 ~ 2iVA" 1 r" 1 ~ 2A^A" 1 (lnt)" 1 . 
Thus, there is a very slow approach to the steady-state. 

4.2. Laguerre polynomials expansion. Consider an expansion of the 
form 



oo 

(4.10) P k (x) = ^2(-lTA^L n (2x)e- x , 

n=0 

subject to the normalization condition (]2.7h . This expansion is a natural 
reformulation of the previous case, justified by the fact that it corresponds 
to another class of solution for (13. li . including non-positive function [4]. It 

(k) 

follows that the coefficients An satisfy the constraint 

oo 

(4.11) 2>n ) = 1 > 

n=0 
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and that the nonlinear evolution (|2.10p becomes 

oo 

(4.i2) 4 fc+1) = EA ( ^4V4 fe i + u< 

1=0 



Clearly, if the initial distribution has positive coefficients {^4^}, they will 
remain so during the evolution. An asymptotic solution can be found from 
(|4"TTj) and (|4Tl2|) . asuming that 

(4.13) A -> 1, A n >i -»■ 0, At > A k > 2 . 

Under these assumptions, the long-time evolution equations become: 

(4.14) 



= A 2 -A{ + 0(A 1 A 2 ), 



dA k 
dt 



A k+1 - A k Ai + 0(A k A 2 ), k>2, 



a . nl _ 2 



which has the solution 

(4.15) A 1 (t) = -+0(t 

T 

(4.16) A k (r) = J^^ t-* + 0(r-^). 

F(a — k + 1) 

Clearly, if we require that A k > throughout the evolution, it follows that 
starting some index k = N, we must have A k >N = 0, and that 

(4.17) Ai = -, A k = p^jr-* K k < N. 

The positivity condition A k > has a clear physical significance: if it is 
not satisfied, we see that starting some value of k, all coefficients become 
negative. Therefore, at fixed t, the tail of the distribution P k (x) is not 
in the exponential class, in fact it can be very far from exponential. The 
exponential-type asymptote is guaranteed only by the positivity condition, 
which effectively truncates the expansion (|4.10p . In turn, this condition 
alone is enough to determine the asymptotic behavior of the coefficients A k 
and therefore of the average E[x] = 1 + — (compare with K9\\ ). 

4.3. Sum of exponentials. The integral in (|2.10p has another important 
property. Let us start with a sum of iV + 1 exponentials 

N 

(4.18) p(x,r = 0) = E^(0)A je - A ^, 

3=0 

with monotonic decay constants Xj < Xj+i- Then, the solution remains a 
sum of exponentials 

N 

(4.19) P (x,t) = Y j Mt)^~ XjX - 

3=0 
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The coefficients satisfy ^2f=o A? = 1 to guarantee normalization. Substitut- 
ing (|4.19p into the master equation (|2.8p . the coefficients evolve according 
to 



(4.20) 



dA k 
dr 



N 



-A k + 2A k Aj 



A, 



3=0 



Replacing the term — A k with — A k ^,=o A?j we rewrite this equation. 



(4.21) 



dAk 
dr 



N 



j=0 3 



There are N + 1 steady-states of the type A k = 5 k j but only the steady- 
state A k = 5 k fi is stable. Small perturbations to this steady-state decay 
exponentially fast 



(4.22) 



Ai 



exp 



Afc — Aq 
Afc + Ar 



It is simple to show recursively (first for k = N and then for k = N — 1 
and so on) that the coefficients A k decay exponentially as in (|4.22|) . Thus, 
starting from a sum of exponentials ([4.180 . the steady state (|3.5j) is selected, 



(4.23) 



p(x) A exp(-A x) 



as t — > oo. 

The approach toward the steady state is dominated by the coefficient A\\ 



(4.24) 



E[x] — A 1 ~ exp 



Al — Aq 
Ai + An 



A i~ A o 
t x i+ x o . 



4.4. Integral of exponentials. It is straightforward to generalize the above 
from a sum to an integral 



(4.25) P (x,r) = J dXf(X,r)Xe- Xx . 

with dXf(X) = 1. Then, the coefficient /(A) evolves according to 



(4.26) 



Ot 



A' + A 



The only stable steady state is /(A) = 5(An) as in ([4.230 and for all A > An, 
the coefficients /(A) decays exponentially, 



(4.27) 



/(A) ~ exp 



A -A c 
A + A c 
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5. General analysis of convergence to steady-state 

The conclusions of previous sections show that starting from a character- 
istic function featuring a multiple pole (|3.16p at z = —iX, (12.10j) leads to the 
steady-state (|3.12p . with power-law convergence of the first moment. The 
case of a branch cut extending from — iAo to — ioo (|3.17p leads to (|3.12p with 
exponentially fast convergence. These two complementary situations allow 
to explain the general steady-state selection process. 

The generic situation is covered by the the class of distributions (13.15p . 
where a = n — e, < e < 1, n E N, n > 0. The characteristic function is 

A ^ a+1 



(5.1) <P(z) = 

so it has the mixted representation 



iz 



oo 



r(l - e) ( d \ n 1 f ^, _ N A' 

r(i + a) 



where /(A') represents the jump of the function (z — iX) 6 " 1 accross the 
branch cut. This can be interpreted as a combination of distributions of 
type (|3.16p . where now the parameter of the exponential ranges from A 
to oo. By the same argument as before, the combination of exponentials 
decays exponentially fast towards the lowest value of A, while the pole of 
order n + 1 decays algebraically to the pure exponential. This separation 
of time scales in the convergence process allows to conclude that the steady 
state corresponding to an initial choice of type (|3,15p is Xe~ Xx , and the first 
moment converges to A -1 as 

In 

(5.2) E[x] - A" 1 = — . 

At 



6. Conclusions 

Coarse graining of difference processes represents a fundamental gener- 
alization of standard coarse graining with averaging. This procedure is a 
natural description for relevant phenomena ranging from multi-species sto- 
chastic processes to socio-economics. In this paper, we have identified the 
class of stead-states for this process, and shown how a particular, universal 
limiting distribution is chosen, as well as the convergence rate towards the 
steady-state. 
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